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(57) [Abstract] 

[Object] A detection of a subject is carried out while taking 
into consideration the individual difference in a feature area 
position of a discrimination subject, variations in size and 
variations in pickup environments, so as to improve the 
detection rate, and the necessity of verification of the 
positional relationship between feature areas is eliminated 
so that a simple process is realized. 

[Means to Solve the Problems] An image including a face is 
inputted from an image input section 1, and is stored as a 
gray-scale image, and this gray-scale image is subjected to 
a differential process by an image processing section 2 to 
generate an edge image, and this is then stored- Next, at 
a position detection section 3, with respect to the gray-scale 
image and the edge image, by using area models which are a 
plurality of preset judgment element acquiring areas 
corresponding to featuring areas such as the eyes, nose, mouth, 
etc. of a face image, each of the area models is inserted to 
the image while the position being successively specified, 
and the amount of feature is extracted from each of the judgment 



element acquiring areas so that based upon the extracted amount 
of feature, a face image is detected from the image. 

[0016] 

5 [EMBODIMENTS OF THE INVENTION] Referring to Figures, the 
following description will discuss embodiments of the present 
invention, 

(FIRST EMBODIMENT) This embodiment, exemplifies a case in 
which a face detecting operation is carried out with respect 

10 to the discrimination subject detection. 

[0017] Fig. 1 is a bloclc diagram that shows the entire 
structure of a subject detection device which is provided with 
an image input section 1 serving as an image input means for 
inputting an image including a person's face, an image 

15 processing section 2 for carrying out predetermined processes 
on the image inputtedby the image input section 1, and a posit ion 
detection section 3 which, based upon image information 
inputted by the image input section 1 and the image information 
processed by the image processing section 2, detects the 

20 position of the face image. 

[0018] As illustrated in Fig. 2, the image input section 1 
is provided with a CCD camera 11 for picking up a person's 
face and for outputting digital gray-scale image information 
including the face, an image input board 12 for taking in the 

25 digital gray-scale image information from the CCD camera 11, 
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and an image memory 13 for storing the digital gray-scale image 
information taken in by the image input board 12, Here, the 
image to be inputted may be a color image. 

[0019] The above-mentioned image processing section 2 reads 
the digital gray-scale image information from the image memory 
13 , sub j ects this to a differential process so as to be converted 
to edge image information, and stores the resulting information 
in the image memory 13. In other words, the gray-scale image, 
as illustrated in Fig. 3 (a) , is subjected to the differential 
process to generate the edge image as shown in Fig. 3(b) , and 
this is stored in the image memory 13. With respect to the 
extraction of the edge, a Laplacian filter or a Sobel filter, 
etc., which has been well known, is used. 
[0020] Here, since the eyes, nose, mouth, etc. have 
considerable edges so that these are effectively utilized as 
the amount of features. Moreover, in the case when the amount 
of features other than edges is utilized, another image 
processing means is added. Moreover, in the case when only 
the image gray-scale value is used as the amount of features, 
the image processing section is not required. Moreover, the 
image processing is not necessarily carried out on the entire 
image, and it may be carried out for each of collation local 
areas. 

[0021] As illustrated in Fig. 4, the position detection 
section 3 is provided with a model generation section 31 for 



generating area models of a face, a model storage section 32 
for storing the area models generated by the model generation 
section 31, a position specifying section 33 for specifying 
the position at which the area model stored in the model storage 
section 32 is inserted to the digital gray-scale image and 
the edge image, stored in the image memory 13, a feature-amount 
extraction section 34 serving as a judgment element acquiring 
means for extracting the amount of features in each of the 
judgment element acquiring areas within the area model at the 
position specified by the position specifying section 33 and 
a judgment section 36 serving as a judgment means for making 
a judgment as to whether or not the image in question is a 
face image by using judgment-use information stored in a 
judgment-use storage section 35 based upon the amount of 
features within each of the judgment element acquiring area 
extracted by the feature-amount extraction section 34.. 
[0022] As illustrated in Fig. 5, the model generation section 
31 generates the area models which are a plurality of preset 
judgment element acquiring areas corresponding to featuring 
areas such as the eyes, nose, mouth and cheeks etc. of a face 
image. In the area models shown in Fig. 5 (a) , featuring areas 
are set as areas of the eyes, nose, mouth and cheeks, and judgment 
element acquiring areas 41 and 42 for the eyes, a judgment 
element acquiring area 43 for the nose, a judgment element 
acquiring area 4 4 for the mouth and a judgment element acquiring 



area 45 for the cheek are set. In the area models shown in 
Fig- 5(b) , featuring areas are set as areas of the eyes, mouth 
and cheeks, and judgment element acquiring areas 41 and 42 
for the eyes, a judgment element acquiring area 44 for the 
mouth and a judgment element acquiring area 45 for the cheek 
are set. 

[0025] Moreover, area models shown in Fig. 6 are referred 
to as mask models, and each area is represented by a mask. 
Numeric values 1 and 2 are judgment element acquiring areas 
for the eyes, numeric value 3 is a judgment element acquiring 
area for the nose, numeric value 4 is a judgment element 
acquiring area for the mouth, and numeric value 5 is a judgment 
element acquiring area for the cheeks. Here, portions having 
a numeric value of 0 are areas to be excluded. By using such 
mask expressions, it is possible to generate more detailed 
area models . 

[0032] At the position specified by the position specifying 
section 33, with respect to the amount of features to be 
extracted from both of the images,, that is, the digital 
gray-scale image and the edge image, for example, the amount 
of features represented by the following equations are used. 
Here, it is supposed that the area model of a face to be utilized 
is a model shown in Fig. 5(a). Moreover, within the area model. 



the judgment element requiring area 41 for the right eye is. 
represented as RE, the judgment element requiring area 42 for 
the left eye is represented as LE, the judgment element 
requiring area 43 for the nose is represented as N, the judgment 

. 5 element requiring area 44 for the mouth is represented as M, 
the rest of the judgment element requiring areas 45 for the 
cheeks is represented by C. Furthermore, it is supposed that 
each of the digital gray-scale image in the image memory 13 
and the edge image are images having values of pixels 0 to 

10 255. Moreover, P(i) is set to be a gray-scale value of a digital 
gray-scale image at the position i, and E(i) is set to be a 
gray-scale value of an edge image at the position i. 
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